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Abstract 

We empirically analyze the most volatile component of the electricity price time series from two 
North-American wholesale electricity markets. We show that these time series exhibit fluctu¬ 
ations which are not described by a Brownian Motion, as they show multi-scaling, high Hurst 
exponents and sharp price movements. We use the generalized Hurst exponent (GHE, H{q)) to 
show that although these time-series have strong cyclical components, the fluctuations exhibit 
persistent behaviour, i.e., H{q) > 0.5. We investigate the effectiveness of the GHE as a predictive 
tool in a simple linear forecasting model, and study the forecast error as a function of H{q), with 
q - I and q - 2. Our results suggest that the GHE can be used as prediction tool for these 
time series when the Hurst exponent is dynamically evaluated on rolling time windows of size 
50 - 100 hours. These results are also compared to the case in which the cyclical components 
have been subtracted from the time series, showing the importance of cyclicality in the prediction 
power of the Hurst exponent. 
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1. Introduction 


Organized wholesale electricity markets are increasingly replacing vertically integrated sys¬ 
tems around the world. These markets attempt to balance the objectives of short term stability and 
performance with economic competitiveness, efficiency, and long term planning (Hogan (| 20081 l, 
Liu (20091, Loskow P008 1 , Kwon ( 2012[ )). Their structure is designed to take into account 
the unique properties of electricity among commodities; (i) it currently cannot be economically 
stored, so supply and demand must be continually balanced, (ii) injections into the transmission 
network flow according to Kirchhoff’s laws, not from point to point, (iii) the transmission net¬ 
work has finite capacity and many operating constraints which limit the size of injections and 
withdrawals at specific locations, and (iv) the amount of power demanded is typically insensitive 
to price over short time periods. 

In particular, these properties can lead to situations in which the network becomes segmented 
into effectively separate regions, meaning that some producers cannot competitively sell energy 
at certain locations. This segmentation is usually called transmission congestion, and can lead 
to large inefficiencies and costs to consumers. The standard approach to dealing with the above 
is to use a spatial and temporal pricing mechanism that explicitly accounts for the physical and 
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operating constraints on the transmission network and generation units (Bohn et al ( 1984| l). In 
this approach, prices at various locations in the transmission network, which are called Locational 
Marginal Prices (LMPs), are determined with the objective of maximizing social welfare while 
taking into account all physical and operating constraints, and compensating production and 
transmission providers for the marginal costs of their services. 

These prices exhibit a very rich structure: they are high frequency, non-stationary, very sea¬ 
sonal, very volatile at times of peak demand and supply shortages, and fat tailed. From many 
points of view, such as financial risk management, market efficiency, mitigating market power, 
as well as short and long term planning, it is therefore important to understand the structure and 
predictability of these prices (Aggarwal et al. ( 2009| l, Moest et al. ( 2010| l, Benth et al. ( 2012| l, 
[Bottazzi et al. |P012| l, |Wang et al ( 2013| l, Weron (2006l). 

In this paper we show that the fluctuations in the most volatile component of LMPs exhibits 
multi-scaling behaviour and high generalized Hurst exponent values. In addition, we study the 
forecast error of simple linear forecasting models, and how this is related to the generalized Hurst 
exponent. 

In Section]^ we discuss the structure of the available data and its properties. In Section 
we study the seasonality properties of the prices and the multi-scaling behaviour by using the 
generalized Hurst exponent approach. In Sectionj^we connect the properties of the generalized 
Hurst exponent to the forecast error of a linear predictive model. We conclude in Section]^ 


2. Properties of the data 

The electricity markets in the United States have adopted what is known as a multi-settlement 
structure. Market participants freely make bids and offers for electricity at different locations 
in the transmission network which are fed into a centrally organized dispatch and scheduling 
system administered by an independent authority, often called an independent system operator 
(ISO). This bidding and dispatch is managed in a set of successive runs. The first run, performed 
a day in advance of an operating day, is called the Day-Ahead (DA) market. Using the DA 
bids, the ISO establishes a generation and load schedule and DA LMPs for each hour of the 
operating day, at each location (often called node) of the network. The DA market exists to 
help participants and the ISO plan ahead, increase market liquidity, and mitigate market power 


(Loskow (20081). Then, as each hour of the operating day approaches, a Real-Time (RT) energy 


market is administered based on revised generation offers and load forecast. This process results 
in new hourly RT LMPs at each node. RT LMPs are much more volatile than DA LMP’s due to 
changes in fuel costs, unanticipated demand that must be met in real time by existing capacity, 
as well as planned and unplanned generation and transmission outages. 

In more technical terms, the LMP at some node is the marginal cost (expressed in $/MWh) 
of supplying, at the lowest cost, the next increment of demand at that node, while taking into 
account supply and demand and the physical and operational constraints of the transmission 
network. For each node n the DA or RT LMP at time t can be split into three components ( |Liu | 
( l2009l l): 

LMPin, t) = MECit) + MLC(n, t) + MCC(n, t), (1) 

where MFC is the Marginal Electricity Component, MLC is the Marginal Loss Component, 
and MCC stands for Marginal Congestion Component. The MEC{t) component is the price of 
electricity at any given node if there is no congestion or loss to that node. MLC is the cost of 
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Figure 1: An example of the RT MCC component time series in MISO in the time period of 1632 hours starting on 
January 1, 2014. The price is the cost per Megawatt-hour of electricity at a particular node. We observe that the 
congestion component can be both positive and negative and that the price varies over many orders of magnitude. 


transmission losses to a node, and is generally small in comparison with MEC. The MCC com¬ 
ponent is of particular interest to us: it is related to the congestion occurring in the transmission 
network and is the most volatile time series in RT and DA, as can be observed in Fig. [T]for a 
particular node in the MISO market. 

For our study we focus on the DA MCC component of price from two markets: the Midwest 
Independent System Operator (MISO) and Pennsylvania-New Jersey-Maryland Interconnection 
(PJM), for a period of time of 1632 hours, starting January 1, 2014 and ending March 9, 2014. 
There are 1287 nodes for PJM and 2568 nodes in MISO. 


3. Seasonality and multi-scaling 


Given the fact that LMPs are strongly influenced by the local and regional climates and 
supply and demand patterns, one could ask whether there are any cyclic patterns in LMPs, and if 
this influences the predictability of the time series (Brown ( 2012| l). 

For this purpose, we study the discrete Fourier transform (computed with a Fast Fourier 
Transform (FFT) algorithm) of the time series of prices 5,(f) at each node i, from the PJM and 
MISO markets. In Fig. |^we plot the power spectrum of each time series, defined as p,(k) = 
|5,(k)p, with Si(k) - FFT(S evaluated over the whole time range and averaged over all 
nodes in the market. The value in each bin k is given by {p(k)) - Pi(k), where N is 

the number of nodes in the market. One can observe the presence of several peaks in the power 


spectrum, which one can identify respectively as 24h, 12h and 8h cyclic patterns (see also Popova 


[ ( 2004| l, Weron (2006l). These components have a larger size than the rest of the spectrum. 

In order to investigate the properties of the fluctuations of the prices, we next analyze the 
scaling properties using a Hurst exponent approach ( |Hurst | ( fl 95 l| l, [Mandelbrot et al. | ( |1997[ )). 
The Hurst exponent and its generalizations have been used to study financial market behaviours 
(for an introduction see Beran (1994 1 and Baillie | ( 1996| l). Its importance has been stressed in 
the last decade in a series of papers (Di Matteo et al. (|2003|l, Bouchaud et al. (|2004|l, Di Matteo 


|et al. I ( |2005| l, |Lillo et aTT] ( |2004[ ), [Farmer et al. ( 2004] l7 Bartolozzi et al. ( 2007] l, Barunik et al. 
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Figure 2: Average power spectrum of MISO (top) and PJM (bottom) DA MCC prices, obtained through a Fast Fourier 
Transform with averaging over all the nodes in each market. The power spectrum has been calculated from a time series 
of 1632 hours with sample rate of one hour. 
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Figure 3: Analysis of the exponent qH(q) in Eq. for PJM (left) and MISO (right). The red line represents the y = x 
line, and the black line is the average over the market of the function qHi{q). The shaded area represents the minimum and 
the maximum over the market. This figure shows that in MISO market the multi-fractal behaviour is more pronounced 
than in PJM. 


( |2010| l, [Morales et al. ( |2012| ), Barunik et al. | ( |2OT^ , [Morales et ain ( |2013| l, |Kantelhardt et al.] 
[ (200 l|l, Duan and Stanley ( 2010j l), and it has been used as a tool for quantifying the different 
degree of development and efficiency of various financial markets (Di Matteo et al. (20051). 


Multi-scaling has been investigated also through de-trended fluctuation analysis (see for instance 
Kantelhardt et al. (2001[l, Uritskaya and Uritsky (20151 and references therein). In this paper 


we use the Generalized Hurst Exponent (GHE) approach. 

The GHE is a tool used to study the statistical and scaling properties of time series. The 
scaling is characterized by an exponent H(q) which is commonly associated with the long-term 
statistical dependence of the series. It is defined from the scaling of the q-th order moments of 
the distribution of increments ( [Di Matteo^P007| l, [Di Matteo et al. |P003[ l) 


KXt) - 


{\x(t + T)-x{m 

mm) 


0 ' 


qH(q) 


( 2 ) 


where the time interval r can vary between v and T^ax, and X{t) - cumsum{S (f)) is the cumulative 
sum of the time series of interest S (f), and v is the sampling rate. 

Within this framework, two kinds of processes can be distinguished: (i) a process where 
H{q) - H is constant and independent of q; and (ii) a process with H{q) not constant. The first 
case is characteristic of uni-scaling or uni-fractal processes and the scaling behaviour is deter¬ 
mined from a unique constant H that coincides with the Hurst coefficient or the self-affine index. 
This is the case for self-affine processes where q H(q) is linear {H{q) = H) and fully deter¬ 
mined by its index H. In the second case, when H(q) depends on q, the process is commonly 
called multi-scaling (or multi-fractal) and different exponents characterize the scaling of differ¬ 
ent q'-moments of the distribution. The Hurst exponent is related with the the s caling behavior 
observed in power spectra X{k) by = 1 -H 2H(2) (Di Matteo et al. |2003 i)- 

It was noticed in (Di Matteo et al. ( [2003 | l) that the Hurst exponents evaluated using Eq. (|^ 
do not strongly depend on the choice of detrending procedure used on the time series or on t if 
this is taken sufficiently large. Eor the present paper we have verified that using detrendings over 
time windows of size 6t e [6,12] hours, the changes of the values of the Hurst exponents were 
consistently below 10%. 

We analyze the values of the Hurst exponents for the PJM and MISO cumulative time series 
i.e., we evaluate the Hurst exponent on X(t) - cumsum{S (f)), where S {t) are the DA MCC prices. 
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Figure 4: Descriptive statistics of the Hurst exponent H{\), evaluated on the whole time series for each node, for PJM 
(left) and MISO (right), and for Tmax = 19 days and averaged over the whole time series. 


This approach is justified by the fact that in the Day-Ahead market, participants place bids one 
day ahead for each hour, and thus the cumulative sum of the time series is the real return as 
a function of time. In Fig. [^we show the multi-scaling behavior in these markets by plotting 
the average quantity qH(q) in Eq. Q (dark line) together with the shaded area representing the 
standard deviation, and observing that these curves are below their linear trend. Fig. shows 
that prices in both markets exhibit strong multi-fractal behaviour, although this phenomenon is 
more pronounced in MISO. These results are in line with (Bottazzi et al. ( |2012[ )) for the case 
of North-European electricity markets, and can be attributed to the fact that electricity is not 
economically storable. 

A snapshot of the distribution of the Hurst exponent //(I) is shown in Fig. where we plot 
a histogram of H(l) evaluated over the whole time series {6h ^ 1600). We observe that H{1) e 
[0.84,0.98] in PJM and H(l) e [0.85,0.99] in MISO, strongly deviating from the expected value 
of a Brownian motion, H = 0.5. Comparing to H{q) for q = 2, in Fig. |^we plot the histogram of 
H(2) evaluated on the whole time series for each market, observing that H(2) e [0.65,0.95] in 
PJM, and H{2) e [0.8,0.96] in MISO. This shows that the Hurst exponent is indeed not constant 
with q, and in particular in the case of PJM, H{2) is clustered around lower values than H{1). For 
both H(l) and H(2), the generalized Hurst exponents diverge dramatically from the Brownian 
motion value H - 0.5. 

Let us now introduce an extra parameter: the size, 6h, of the moving windows on which we 
calculate the generalized Hurst exponents dynamically. We observed that the Hurst exponents 
computed on short {6h - 50 hours) and long {6h « 1600 hours) time windows have comparable 
results. The dependence and importance of the choice of Sh for forecasting will be addressed 
specifically in the next section. 

To begin with, we evaluate the Hurst exponents dynamically in a moving window of length 
6h = 50. In Fig. and Fig. the black line is the average generalized Hurst exponent, for 
H{1) and H{2) evaluated on the real and filtered signal. In the latter case, we consider the 
signal with the frequencies which dominate the power spectrum subtracted (in particular, the 
6h, 8h, 12h and 24h compo nents). The average is taken over the nodes i in the market, i.e., 
(Hiiq)) - jj Hjig). See (Morales et al. (2013 i) for a similar analysis performed on stock 
market data. The use of a short time window with 6h - 50 hours will be further motivated in the 
next section, where we will suggest the use of this training window to minimize forecast errors. 
It is also interesting to note that even if evaluated on such a short window, the values of these 
exponents appear to be in the same ranges as those evaluated on the whole time series. 
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Figure 5: Descriptive statistics of the Hurst exponent H{2), evaluated on the whole time series for each node, for PJM 
(left) and MISO (right), and for r^ax = 19 days. 


For both PJM and MISO, the Hurst exponent is subject to rather strong fluctuations and spiky 
behaviour. We note that the latter is rather attenuated when we consider the signal from which 
the cyclic components have been removed, but still the Hurst exponents oscillate in the range 
H{\) X 0.6 - 0.9 and H{2) ^ 0.5 - 0.85 for both markets, which confirms the persistence of the 
fluctuations. Even after the signal has been filtered, we note that some abrupt transitions occur 
for both H{\) and H{2). Further, inFig.|^we show that there are changes in i/(l) and H{2) which 
are coherent across the entire market. In the case of some of these sharp movements, we could 
identify specific weather events which could have potentially triggered this coherent behaviour. 
For instance, in the case of PJM, the sharp transition occurring at f a; 880h corresponds to a 
severe snowfall occurring in Pennsylvania on the 5th of February 2014. We thus argue that the 
behaviour of the fluctuations can be interestingly connected to specific exogenous factors. 


4. Generalized Hurst exponent and trends 


Several studies have suggested that the Hurst exponent might be a measure of predictability of 
time series in stock markets (for instance |Lillo et al71 ( |20041 l, [Farmer et al.|P004| l) and connected 
it to the efficient market hypothesis. It has been studied in detail in different models of stock 
markets as a measure of returns predictability in ( Duan and Stanley1 (2010|l) and (|Miti ^ j2012 1), 
and as a predictor of forecast quality for neural networks models in (Qian et al. ^ 2007| l). The 
relation between the Hurst exponent and the efficient market hypothesis has also been studied 
in (Eom et al. (2008 1 , Eom et al. (|2008 1 ). The predictability of Canadian electricity market 
prices using detrendend fluctuations is analysed in ( [Uritskaya and Uritsky (20151). There is also 
a large literature on the predictability of electricity prices, for examples see Aggarwal et al. 
( 2009] l, Moest et al. ( 2010| l, Benth et al. ( 2012| l, Wang et al ( 2013| l. Our focus will be on 
applying the Generalized Hurst exponent method for forecasting purposes. In order to do so, we 
introduce a simple linear regression model and measure the dependence of the forecast error on 
the Generalized Hurst exponent evaluated dynamically for each time series. 


4.1. The model 

Consider the simplest forecast method, a linear regression model. In particular, for each 
time-series 5,, we extrapolate the next p-points by means of a linear regression performed on 
the previous 6h points: 5,(f + p) - Pip + Po, with the intercept fixed at the last observation 
Pi) = S (t). It is well know that linear regression suffers from various problems, since it relies 
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Figure 6: Average H(l) and H(2) exponents for PJM evaluated dynamically, with and without filtering, on a moving time 
window of 6h = 50 hours. The dark line represents the average value across the market, meanwhile the shadowed area 
represents the standard deviation. We observe that for both filtered and unfiltered time series the average value of //(I) 
oscillates around high values of the Hurst (w 0.5 - 0.9), although some nodes occasionally have values below H = 0.5, 
thus exhibiting also anti-persistent behavior. H{2) is consistently lower than H{\), with H{2) « 0.45 - 0.82. In general 
both exponents differ strongly from the Brownian motion expected value oi H = 0.5. We note that due to the short time 
window on which the Hurst is calculated here, these values are consistently lower than the one evaluated on the whole 
time series, as in Fig. In addition, many of the spikes observed in the unfiltered signal disappear or are attenuated in 
the filtered case. 
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Figure 7: Average H(l) and H(2) exponents for MISO, with and without filtering, calculated on a moving time window 
of 6h = 50 hours, as in Fig. The dark line represents the average value across the market, and the shadowed area 
represents the standard deviation. We observe that for both markets the average values of //(I) and 7/(2) oscillate ai'ound 
high values, H(\) x 0.5 - 0.9 and 77(2) » 0.5 - 0.8, and 77(2) has a systematically lower value than 77(1). Finally, the 
filtered signal shows less cyclicality and spiky behavior. 
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on the normal distribution of errors, does not take into account heteroscedasticity, and does not 
capture non-linear or chaotic patterns. Our goal here is to test the relationship between the Hurst 
exponent and the persistence of a trend as measured by a linear model. These regressions are 
performed for each node in the market independently. For each prediction, one can associate 
an error and two independent datapoints given by the values of the Generalized Hurst, //,(1) and 
Hi{2) evaluated over the training window. More precisely, we will study the relationship between 
forecast error and these Hurst exponents. 

4.2. Results 

We introduce the forecast error, Ei(t,p) - \S ,{1 + p) - S i(t + p)\, with implicit training 
window 6h. We then compare the forecast error at time t with the values of the Generalized 
Hurst exponents //,(2) computed in the time window [f - 6h,t] for the time series i. 

Given the prediction window 6h, there are (1632 - 6h) x N errors and Generalized Hurst values, 
where N is the number of time series in the market, and 1632 is the number of hours available for 
our analysis. In Fig. [^we plot the density of points in the semi-log scatter plot of Generalized 
Hurst exponents versus forecast error for 6h = 50, evaluated at p = 1 both for PJM (left) and 
MISO (right), together with the best fit, for both q - I (top) and q - 2 (bottom). Similar 
results were obtained also for 6h - 50 - 100 hours. We observe a negative dependence between 
the values of the Generalized Hurst exponent and the prediction error, implying that for higher 
Hurst exponents one has better forecasting power. This indicate that H{q) and E(H(q)) have a 
functional dependency: E{H{q)) ^ where c is the slope in the log-linear fit. 

In addition, we study the effect of the seasonal components shown in Fig. |^by taking the 
filtered time series, in which the 2Ah, I2h, 8/1 and 6/1 components have been removed. The results 
for the linear fit slope c for both original and filtered time series are reported in Fig. |^(top) and 
Fig. [^(bottom) for 6h - 50 hours, for //(I) and //(2). 

We observe that the results are strongly affected by filtering the time series. The dashed lines 
(filtered) are above the full line (unfiltered), showing the importance of the strongly cyclical 
components for the trend of the time series as measured by the Hurst exponents. These results 
apply, qualitatively, also to the case of the MISO market, where we observe smaller values of c 
in absolute value, but similar patterns in the curve c{p) shown in Fig. 

This analysis suggests that the Generalized Hurst is a good estimator of trend persistence in 
the case of the electricity markets considered here, and we note that in general H(2) is a better 
estimator than H{1). In addition, pries in PJM are more predictable than in MISO. 

5. Conclusions 

In this paper we studied the Generalized Hurst exponent for the Day-Ahead Marginal Con¬ 
gestion Cost components of electricity prices in two North American wholesale electricity mar¬ 
kets. We observed that these prices exhibit strong multi-scaling behaviour and deviation from 
Brownian motion. We also observed that in the power spectrum of the time series several peaks 
associated to daily cycles can be identified. We found that the values of the Generalized Hurst 
exponents, H(l) and H(2), are are clustered between 0.7 and 0.8 for both markets. To our knowl¬ 
edge, this is the first analysis of Generalized Hurst exponents performed for these electricity 
markets. Doing a dynamic analysis of these exponents using moving windows of 50 hours, we 
found that the generalized Hurst exponents have values which are consistently related with those 
evaluated on longer time windows, and have coherent market movements. 
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Figure 8: Density plot of mean squared forecast error versus H{q) for PJM (left) and MISO (right), for q = I (top) and 
q = 2 (bottom), for the case of a linear regression forecast and with training window 6h = 50. This shows that the 
dependence on the Hurst is negative. The line is given by the linear fit E{H{q)) % with £0 the intercept and c 

is the slope in the log-linear plot. 
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We have also shown that the Generalized Hurst exponent is a good estimator of the per¬ 
sistence of trends in the time series if the strongly cyclical components are taken into account, 
supporting the hypothesis that for higher Hurst exponents (>=» 0.5) the fluctuations are trend sup¬ 
porting and thus simple linear models can be used to perform predictions. In general the results 
are different depending on the training window. In fact there is a negative correlation between 
the Hurst exponents and the forecast errors of the regressions, and this correlation depends on the 
size of the forecast horizon. Using a training window between 50 - 100 hours provides the best 
results. In analogy to the case of stock markets, where the Hurst exponent has been connected 
to the efficient market hypothesis (Di Matteo et al. (20031, Lillo et al. (2004|l, Di Matteo et al. 


[ (20051), we have observed that indeed the Hurst exponent can be connected to the error in the 
prediction of returns. 
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